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(54) Abstract Title 

Driver drowsiness monitor and recognition system 

(57) A system for a vehicle having a camera which is used to derive the facial characteristics of the vehicle 
operator. These characteristics are used to monitor the operator for signs of fatigue and provide a warning 
when fatigue is detected. The characteristics may also be used to identify the operator of the vehicle to prevent 
operation of the vehicle by an unauthorised person. The system may also incorporate data logging facilities 
which can record, transmit and receive data to and from remote locations. 
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Transport Security and Safety System 

Definition: 'Operator \ for the purposes of this patent application, means the human driver, pilot, 
captain, or any person in a position of direct control of the transport. 

This invention is concerned with a system that improves transport security, control and 
monitoring including the continuous monitoring of the human operator of a transport for 
behavioural indicators including fatigue. 



Other devices for providing measures of transport security are well known and these, which 
include keys and electronic coding techniques, are known to be unreliable. Devices for 
monitoring human operator behaviour including detecting operator fatigue using the method 
described in this patent are not known to exist. 

An object of this invention is to provide a new approach to improving transport security, control 
and human behavioural monitoring including the detection of human fatigue. 



Accordingly, this invention provides a system that initially identifies the operator of a transport 
as being authorised to operate that particular transport. This is to be achieved by the use of one or 
more cameras, which are used to derive operator fecial characteristics. These characteristics, and 
in particular the characteristics of the human iris, are used in a ™«*^nig process to positively 
identify the operator before the system permits the transport engine or power source to be 
started. Once a journey is commenced the system continuously monitors various aspects of the 
transport, as is described more fully below, together with human operator behaviour and in 
particular the operator's eyes and eyelids for signs of fatigue. The system issues visual and 
audible warnings when fatigue is detected. The system also incorporates data logging facilities 
and these can record, transmit and receive data to and from remote locations, events as they 
occur. The System may also incorporate facilities for prescribed dements of remote control. 



The system is to be made of a suite of enclosures, components and cables that interlink to form 
the system. The system can be surface mounted in existing transports or may instead be 
incorporated as part of a new transport build. 



A preferred embodiment of the invention will now be described with reference to the 
accompanying drawing in which: 



Figures 1-3 shows the views of an operator, which for the purposes of this drawing illustration, is 
a driver of a motor vehicle. The drawing shows the approximate dimensions of a detection cone 
created by camera(s) within which the operator's facial characteristics can be determined. The 
figures depict a system incorporated as part of a transport new build. A surface mounted system 
would be similar except that certain components would need to be separately mounted. 
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>ort S< 



and Safety System 



Fig 4 is described as follows: - 

Central Processing and Control. This central part of the 
described below: - 



system coordinates all sub-systems as 



S^ 7 ^TF- SulVSyStem > of the system determines an operator's head location and 



Characteristics and Matching: Sub-system; this part of the system com™™ , 
images with stored database information to identifV the o«~»w ^ compares digital 

deploys a face and iris matching algorttm^^^ 

^J^O^^^^ ^ - - continuously 

£™*Z E^J°* M<™&™nt System: Sub-system; this part of the system is used to 
pTofXe Z^ Jr.TJf^ t0beStarted foUowin g ^o^ed operator ide^ca^oTriS 



^ITI ""t Customisation: Sub-system; this part of the system is used to facilitate date 
by the transport owner to initialise and customise system operation. 



Telemetry: Sub-system; this part of the syst< 



communicate information as reouir*H t« T«~ ~* * USCd to determine transport 

mionnauon as required to and from one or more remote locations. 



and 



Data Logging: Sub-system, this part of the system is used to store data. 

^£22^ °7! u AudibIe Sub-system; this part of the system is used 

to the operator of the transport. u&cu 



convey messages 



Where appropriate the systems and sub-systems described above are to be housed within «. 
enclosure made of a material that win be resistant to impact and fire damage. 
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CLAIMS 

1. A transport security, control and monitoring system that provides a means of improving 
transport security, control and monitoring including the monitoring of the human 
operator 1 of a transport for behavioural indicators including fatigue. 

2. A system as claimed in Claim 1 wherein one or more cameras are used to determine an 
operator's head location and derive digital images of sufficient facial detail to enable 
further image processing work to be carried out. 

3. A system as claimed in Claim 1 wherein face and iris matching algorithms are used in 
conjunction with stored database information to identify the transport operator. 

4. A system as claimed in Claim 1 that permits a transport engine or power source to be 
started only if the operator is authorised to control or drive that particular transport. 

5. A system as claimed in Claim 1 that continuously monitors the operator's facial 
movements, eyes and eyelids for signs of fatigue. 

6. A system as claimed in Claim 1 that stores data including the transport data such as 
movement and speed. 

7. A system as claimed in Claim 1 that determines the transport location and 
communicates information, including that of Claim 6, to and from one or more remote 
locations. 

8. A system as claimed in Claim 1 that is capable of receiving data from one or more 
remote locations and that can provide prescribed elements of remote control. 

9. A system as claimed in Claim 1 that conveys visual and audible messages to the 
operator of a transport 

10. A system as claimed in Claim 1 of interlinking enclosures, components and cables that 
can be incorporated in the build of new transports or surface mounted in existing 
transports. 

11. A system as claimed in Claim 10 that is made from enclosures, components and cables 
resistant to impact and fire damage. 

12. A transport security and safety system substantially described in pages 1-4 herein and 
illustrated in Figures 1-4 of the accompanying drawings. 

1 for the purposes of Ms patent, 'Operator 9 means the human driver, pilot, captain or any person in a position of 
direct control of the transport 

2 for the purposes of this patent, 'transport 9 means motorised vehicle, aeroplane, marine vessel, train or anything 
capable of transporting persons or things from one place to another. 
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